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(57) An apparatus displays an image [1 40] in three- 
dimensional virtual space in a form that may be modified 
by a user using an interface device [500]. The apparatus 
divides computer-generated data representing 3D im- 
ages into data subsets representing two-dimensional 
slices of the 3D image. The apparatus displays each im- 
age slice on a layer In a stack of liquid crystal displays 
(LCD) [210-219]. The stack sequentially displays the 
layers of the image at a fast rate to appear as a single 
3D -image [140]. Each layer in the stack has a dedicated 
driver and memory. The apparatus includes a reflector 
[400] for reflecting the 3D image in a manner so as to 
produce a virtual image in unsurrounded space capable 
of being viewed from every direction. Spectators may 
use a user interface device [500] to touch or manipulate 
the virtual image. The user interface dev'ce [500] trans- 
mits data to the apparatus, which generates data to 
modify the virtual image. 




User InlerfaoB 1 
Device 500 



Vitual 
Image 140 




1 



Display 
Controllw 




: Display j 
Device ' 
I 200 



120 



130 



r. 



Processor 100 



CO 
CN 
O) 



CL 
LU 



FIG. 1 



Printed by Jouve. 75001 PARIS (FR) 



BNSDQCID: <EP 



092B117A2 I > 



1 



EP 0 928 117 A2 



2 



Description 

BACKGROUND OF THE INVENTION 

[0001] The present invention relates to nnethods and 
apparatus tor displaying an image in three-dimensional 
physical space and nnanlpulating the image using an in- 
terface device. More specifically, the present invention 
allows computer-generated images to be projected into 
three-dimensional space and then subsequently 
touched or manipulated by a human being using a hap- 
tic-touch device. 

[0002] Volumetric projection is technology that allows 
three-dimensional (3D) objects to be projected so that 
they appear to float in mid-air. Volumetric projection 
technology with human interactive capability has vast 
implications for a host of 3D-based applications such as 
computer-aided design/computer-aided manufacturing 
(CAD/CAM), industrial design teleconferencing, and 
computer network management. Other applications 
may include virtual prototyping of new products, tele- 
medical applications such as medical training tools, and 
virtual desktop display nrtonitors. 

[0003] True 3D imaging systems take into account the 
way humans perceive 3D objects and rely on both psy- 
chological and physlok>gical depth cues to interpret the 
visual information. The physiological depth cues are ac- 
commodation, convergence, binocular parallax, and 
movement parallax. The psychological depth cues are 
retinal image size, linear perspective, texture gradient, 
overlapping, aerial perspective, and shades and shad- 
ows. Scientists generally agree that superior 3D display 
devices would provide some or all of these characteris- 
tics. This is observed in the article entitled "Direct Vol- 
ume Display Devices" by T. L. Clitton et al., Computer 
Graphics and ApplicatkDns, vol. 1 3, no. 4, pp. 57-65, July 
1 993, the contents of which are hereby incorporated by 
reference. 

[0004] There have been many attempts to display re- 
alistic. Interactive 3D images, all of which suffer draw- 
backs. For example, some conventional devices display 
3D information on a 2D screen and rely on techniques 
such as overlapping, linear perspective (making objects 
in the distance appear smaller), and shading to simulate 
depth. Adding depth cues in this manner is computa- 
tionally intensive and the resulting Images still can be 
viewed only from one direction for the 3D effect. The 
more powerful physiological depth cues, such as ac- 
comnrxxjation, convergence, and binocular disparity, 
cannot be used in these instances, making it difficult for 
human beings to perceive, interpret, and ultimately un- 
derstand the visual image. Furthermore, because these 
images are restricted to a screen, it is impossible to in- 
teract with them in a truly 3D sense. 
[0005] Virtual objects are computer-generated imag- 
es that are projected into the user's environment. Be- 
cause they provide many of the depth cues, virtual ob- 
jects, for better or worse, allow people to apply their ex- 



isting senses, their sense of physical space, and social 
rules to interact with the objects. 

[0006] Some conventional devices, such as head- 
tracking technologies, produce virtual objects but re- 

5 quire the use of encumbering hardware, such as polar- 
izing glasses or head gear. In stereoscopic display de- 
vices of this type, two views of an object are displayed 
to the right and left eyes of an wearing specially outfitted 
glasses. Besides the obvious drawback of requiring 

10 bulky headgear, head-tracking technobgies necessi- 
tate intensive calculations for determining and synchro- 
nizing the view for each eye for every angle. 
[0007] Still other existing technologies project objects 
into 3D space within an enclosed space, thereby ham- 

^5 pering spectator interaction. Direct Volume Display De- 
vices (DVDDs), for example, display 3D images by pro- 
jecting multiple invisible infra-red laser beams through 
an enclosure that contains a reflecting material such as 
a gas or a rotating helix. While, the enclosure surround- 
20 ing the 3D images is necessary to separate the specta- 
tors from harmful moving parts or confine the gas, it pre- 
vents spectators from touching or otherwise interacting 
directly with the 3D image. 

[0008] As is apparent from the above-described defi- 
es ciencies with conventional systems, a need exists for a 
method and apparatus that presents a realistic 3D im- 
age with both the physiobglcal and psychotogical depth 
cues. 

[0009] A further need exists for a method and appa- 
30 ratus for displaying 3D images so that they may be 
viewed from ail skies. 

[0010] Yet another need exists for a method and ap- 
paratus that projects the object into 3D space without 
an enclosure around the object. 
3s [0011] An additional need exists for a method and ap- 
paratus that projects into unsurrounded space a 3D im- 
age that is fully referenceable. 

[0012] A still further need exists for a method and ap- 
paratus that allows spectators to interact with the 3D im- 
40 age. 

SUf^MARY OF THE INVENTION 

[0013] To address these concerns and limitatkjns, 
45 methods for displaying a three-dimensional image com- 
prise receiving a first set of data representing a three- 
dimensional image; projecting a first plurality of light 
beams based upon the first set of data onto a reflective 
device; and reflecting the light beams to focal points 
so above the reflecting device in a manner to display a ref- 
erenceable three-dimensional image in unsurrounded 
space. 

[001 4] Additionally, a method of displaying a three-di- 
mensional image comprises receiving a first set of data 
5S representing a three-dimensional image; dividing the 
first set of data into a first plurality of data subsets, each 
data subset corresponding to a two-dimensional slice of 
the three-dimensional image; projecting a first plurality 
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of light beams onto a reflective device in accordance 
with the first plurality of data subsets; and reflecting the 
first plurality of light beams to focal points beyond the 
reflective device to display a referenceable three-di- 
mensional image in unsurrounded space. 
[001 5] Additionally, a method of displaying a three-di- 
mensional image comprises receiving a first set o1 data 
representing a three-dimensional image; dividing the 
first set of data into a first plurality of data subsets, each 
data subset corresponding to a two-dimensional slice of 
the three-dimensional image; activating a plurality of 
light beams based upon the first plural'ity of data sub- 
sets; and projecting the plurality of light beams to focal 
points to display a referenceable three-dimensional im- 
age in unsurrounded space. 

[0016] Furthermore, an image display apparatus 
comprises a device for receiving a first set of data rep- 
resenting a three-dimensbnal image; a first projector for 
projecting a first plurality of light beams onto a reflective 
device based upon the first set of data; and a device for 
reflecting the light beams to focal points above the re- 
flecting device in a manner to display a referenceable 
three-dimensional image in unsurrounded space. 
[0017] Additional advantages of the invention will be 
set forth in part in the description that follows and in part 
will be obvious from the description or may be leamed 
by practice of the invention. The advantages of the in- 
vention will be realized and attained by means of the 
elements and combinations particularly pointed out in 
the appended claims. Both the foregoing general de- 
scription and the following detailed description are ex- 
emplary and explanatory only, and are not restrictive of 
the invention as claimed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[001 B] The accompanying drawings, which are incor- 
porated in and constitute a part of the specification, il- 
lustrate presently preferred embodiments of the inven- 
tion and, together with the general description given 
above and the detailed description of a preferred em- 
bodiments given below, explain the principles of the in- 
vention. 

[0019] Fig. 1 illustrates one embodiment of the appa- 
ratus of the invention. 

[0020] Fig. 2 Illustrates display device 200 of Fig. 1 . 
[0021] Fig. 3 is a block diagram illustrating display 
controller 300 of Fig. 1. 
[0022] Fig. 4 shows reflector 400 of Fig. 1. 
[0023] Figs. 5A-5B contain a flow diagram of a meth- 
od for displaying a 3D image according to the present 
invention. 

[0024] Fig. 6 shows the reflection process when re- 
flector 400 is a pair of concave mirrors 410 and 420 as 
shown In Fig. 4. 



DETAILED DESCRIPTION OF THE INVENTION 

A. Introduction 

5 [0025] Reference will now be made in detail to pre- 
ferred embodiments of the invention, examples of which 
are illustrated in the accompanying drawings. Wherever 
possible, the same reference numbers will be used 
throughout the drawings to refer to the same or like 

10 parts. 

[0026] Consistent with the invention, a system gener- 
ates a 3D image arid cuts it into a series of image slices. 
The system transmits data representing the image slic- 
es to a display controller that sequentially displays the 

^5 image slices on a stack of two-dimensional arrays. A re- 
flector of the system reflects the image to create a virtual 
image that appears to be floating in mid-air. A spectator 
uses an interface device to touch and manipulate the 
virtual innage. The interface device generates data and 

20 transmits the data to a processor of the system, which 
is used to compute and affect changes in the virtual im- 
age. 

B. System Components 

25 

[0027] Fig. 1 illustrates the components of a system 
consistent with the present invention. Generally, the 
system Includes processor 1 GO, display device 200, dis- 
play controller 300, reflector 400, and user interface de- 

30 vice 500. Processor 1 00 is connected to display control- 
ler 300 via standard data bus 1 20 and is connected to 
user interface device 500 via standard data bus 1 30. 
Display device 200 is connected to display controller 
300 via standard data bus 1 25. 

35 [0028] Processoi- 100 is shown in Fig. 1 as a conven- 
tional personal computer. Processor 100 preferably 
comprises a processor with sufficient memory and 
processing capability to perform the disclosed function- 
ality. Processor 100 may also comprise one or more in- 

40 put/output devices such as a mouse, keyboard, or dis- 
play terminal. 

[0029] Display device 200 is a 3D imaging device ca- 
pable of displaying a 3D image in three coordinate 
planes in a fully referenceable form. The term 'refer- 

45 enceable" is used to descnbe an image that is displayed 
so that a spectator can reference any of the x, y, and z 
coordinates of the image. Referenceable images also 
maintain a fixed position when viewed from varying po- 
sitions surrounding the display. 

50 [0030] Fig. 2 illustrates display device 200 in accord- 
ance with one embodiment of the inventrc>n. As shown 
in Fig. 2. display device 200 is a stack of two-dimension- 
al arrays 210 - 219. Each array preferably comprises 
one or more light elements 265, each light element be- 

S5 ing capable of emitting a beam of light. For example, in 
a preferred embodiment, each of arrays 210 - 21 9 con- 
tains a plurality of gray scale liquid crystal display (LCD) 
light elements 265, or pixels. While the arrays in Fig. 2 
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are shown as mounted on top of one another in a stack, 
the arrays may also be arranged side-by-side. Each ar- 
ray is addressable along the z axis and the pixels in an 
array are addressable along the x and y axes. While the 
number of arrays shown In the stack of Fig. 2 Is ten, the 
number of arrays can be more or less. Configurations 
using a more closely packed array will yield a finer ref- 
erenceable resolution. Alternatively, display device 200 
could comprise other types of conventional display de- 
vices such as an earth -doped crystal display as de- 
scribed in '30 in a Cube" by Robin Yeary printed in IEEE 
Computer Graphics and Applications, Nov. 1996, vol. 
16, no. 16, or the LCD display described in U.S. Patent 
No. 5, 113,272 to Reamey. 

[0031] As mentioned earlier, in a preferred embodi- 
ment, arrays 210 - 219 are implemented using LCDs. 
LCDs require an external light source 360 to illuminate 
the pixels. LCDs have two distinct modes of operation. 
In the 'off state, the LCD is transparent. In that mode 
the light flows through the LCD with minimal absorption. 
In the 'on' state, the image slice information is presented 
on the LCD and the appropriate pixels are activated. 
[0032] In an alternative embodiment, each array is a 
matrix of light emitting diodes, or LEDs. An LED emits 
light when a current is passed through it. A configuration 
using LEDs instead of LCDs would be essentially the 
same except that the LED configuration would not re- 
quire light source 360. Furthermore, LEDs typically have 
a large pixel size than LCDs and may be preferred in 
some applications. 

[0033] Fig. 3 shows display controller 300 in accord- 
ance with a preferred embodiment of the present inven- 
tion. Display controller 300 comprises drivers 310-319, 
memories 320- 329, multiplexer 330, and sequencer 
340. Each driver and memory in display controller 300 
is associated with a particular array in display device 
200. Driver 310. for example, controls the operatkjn of 
array 210; driver 311 controls the operation of array 211 . 
Each driver and memory is also connected to an array 
in display device 200 via one or more standard data bus 
361 - 369. Sequencer 340 is preferably a custom pro- 
grammable application specific integrated circuit (ASIC) 
and is capable of controlling drivers 31 0-31 9 via stand- 
ard data bus 380. 

[0034] Referring back to Fig. 1 , reflector 400 is a de- 
vice that reflects the displayed image so that a virtual 
image of the 3D object appears to be suspended in mid- 
air unsurrounded by the reflector or other apparatus and 
is able to be viewed by spectators from many different 
viewing angles up to 360 degrees. The viewing angle 
may be less than 360 degrees with some types of dis- 
play devices 200 mentioned above. Reflector 400 may 
be, for example, a pair of spherical concave mirrors as- 
sembled together as shown in Fig. 4. As shown in the 
top of Fig. 4, the interior surfaces of the concave mirrors 
41 0 and 420 are covered with a reflective material. Pref- 
erably, at least one of concave mirrors 410 and 420 has 
an opening 430 preferably centered with a central axis 



of the sphere. Opening 430 may be of any size or shape 
but is preferably circular Concave mirrors 41 0 and 420 
are joined together so that the mirrored surfaces face 
one another and the circular edges are aligned. The bot- 

5 torn of Fig. 4 shows two views of the resulting parabolic 
mirror 440 after joining concave mirrors 410 and 420. 
[0035] In an alternative embodiment, reflector 400 
may be a Fresnel lens. A Fresnel lens is a thin optical 
lens consisting of concentric rings of segmental lenses 

10 that replbates the optics of glass lenses or curved par- 
abolic mirrors. With a Fresnel lens, the optics of the lens- 
es or mirrors are maintained but the bulk, volume, or 
area of the lenses or mirrors is substantially reduced. In 
yet another embodiment, other mirror configurations 
can be used to limit the viewing area. For example, by 
cutting each concave mirror in half, the viewing angle 
can be limited to 180 degrees. 

[0036] Referring again to Fig. 1 , user interface device 
500 may be a conventronal. commercially available 
20 force feedback haptic interface device designed to pro- 
vide force feedback information generated by virtual 
simulation. User interface device 500 may be a device 
worn on a hand or fingertip or a freely held pen-like tool 
or stylus. Other devices may be suitable provided that 
25 they operate with appropriate force-feedback sensitivity 
or resolution so as to allow the spectator to detect and 
manipulate the image. For example, a very low resolu- 
tion data glove may be appropriate for a simple volumet- 
ric game interface with low resolution but entirely inap- 
30 propriate for simulating volumetric open-heart surgical 
procedures where high resolution is desirable. There- 
fore, user interface device 500 preferably has resolution 
comparable to the resolution of display device 200. One 
example of such a device is the PHANToM haptic infer- 
os face product distributed by SensAble Technologies. Us- 
ers connect to the PHANToM device by wearing a thim- 
ble that tracks the nrxMion of the user's finger tip and ex- 
erts pressure on the fingertip to give the user the sen- 
sation of touching solid physical objects. Another exam- 
40 pie is the PHANToM stylus product also by SensAble 
Technologies. 

C. Process 

45 [0037] Figs. 5A and SB illustrate a process for display- 
ing and manipulating a 3D image consistent with the 
present invention. 

[0038] To begin, processor 100, or in an alternative 
embodiment a processor externa! to processor 100. 

50 generates a 3D image (step 505). Processor 100 or the 
external processor may generate the 3D image using 
any commercially available 3D graphics software pack- 
age, such as Silicon Graphics' Cosmo Worlds applica- 
tion or Alias Wavefront's Animator application, provided 

55 the resulting 3D image is capable of being displayed us- 
ing at least three coordinate planes. If the processor 
generating the 3D image is external to processor 100, 
the image is stored to a data storage device, such as a 
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hard disk, CD-ROM, or optical storage unit and trans- 
ferred to processor 100 using an input/output device 
such as a disk drive or modem. 

[0039] It the data representing the 3D image is not in 
a format suitable for display on display device 200 (step 
51 0), processor 1 00 reformats the data into image "slic- 
es" (step 515). A "slice" is a subset of the image data 
representing a two-dimensional image layer of the 3D 
image. The reformatting process may be implemented 
using one or more software or hardware programs. In 
the preferred embodiment, however, the reformatting 
process is implemented using software custom de- 
signed to operate specifically with display device 200. 
Each two-dimensional image slice is displayed using 
one or more of the arrays of display device 200. 
[0040] If the data is in a suitable format or after exe- 
cution of step 51 5. processor 1 00 transmits the data slic- 
es to display controller 300 (step 520). Multiplexer 330 
of display controller 300 selects which of memories 320- 
329 receives data from processor 100 (step 530). Each 
image slice is stored in one or more of memories 
320-329. Multiplexer 330 routes the data corresponding 
to a particular image slice to its corresponding memory 
320-329 (step 530). For example, data related to the im- 
age slice that is displayed on array 210 is stored in mem- 
ory 320. Data to be displayed on array 211 is stored us- 
ing memory 321. For static images, the memory prefer- 
ably receives data only once. If the image is moving, or 
is changed by actions of user interface device 400^ mul- 
tiplexer 330 selects which of memory 320- 329 needs 
to be modified. 

[0041] Arrays 210-21 9 may either be all turned on si- 
multaneously or scanned through in a serial fashion 
(step 535). In serial mode, sequencer 340, as shown in 
Fig. 3, controls drivers 310- 31 9 so that arrays 210-21 9 
are activated sequentially (step 540). Preferably, the 
compKxients of display device 200 are configured so that 
display device 200 has a response time capable of sup- 
porting moving images. For example, to display an an- 
imated image at a video frame rate of 30 video frames 
per second, the entire stack of arrays will be modified 
30 times per second. Therefore, for example, if display 
device 200 is a stack of 5 arrays, display device 200 
must operate at a speed fast enough to refresh 150 ar- 
rays in a second. With a stack of 10 arrays, display de- 
vice 200 must refresh 300 arrays per second to display 
30 video frames per second. 

[0042] The display must also have a high light trans- 
mission rate. Display technology such as PDLC (poly- 
mer dispersed liquid crystal) or Guest Host LCD operate 
without a polarizer, thus minimizing light absorption. 

Minimal light absorption is essential as more LEDs or 
LCDs are stacked. 

[0043] Whether a static or moving image, drivers 
310-319 activate arrays 210-219 to display the 3D im- 
age (step 550). After display device 200 displays the vir- 
tual image (step 560), reflector 400 reflects the image 
(step 570). Fig. 6 shows the reflection process when re- 



flector 400 is a pair of concave mirrors 410 and 420 as 
shown in Fig. 4. As shown in Fig. 6, displayed image 
610 is reflected off the interior walls of the mirrors and 
a virtual image 620 appears above the opening to the 

5 sphere. The virtual image is unsurrounded and specta- 
tor 630 may view virtual image 610 from 360 degrees. 
The virtual image Is also fully referenceable in that the 
spectator can reference any point in the 3D image. 
[0044] Spectators may manipulate the virtual image 

10 using user interface device 500. User interface device 
500 allows users to touch* virtual objects by providing 
force feedback based on the computer-generated virtu- 
al image. User interface device 500 is calibrated and 
aligned to the virtual image so that the user appears to 

IS touch the virtual image. If user Interface device 500 is 
used (step 560), movements of user interiace device 
500 generate data which Is transmitted to processor 1 00 
(step 590). Processor 100 modifies the image slices us- 
ing data from user interface device 500 (step 595). The 

20 modified image slices are sent to display control 300 and 
the process continues from step 520. If user interface 
device 500 is not used, the image is not modified and 
processor 100 waits for use of user interface device 500 
(step 565). 

25 

D. Conclusion 

[0045] It will be apparent to those skilled in the art that 
various modifications and variations can be made in the 

30 system and processes of the present invention without 
departing from the spirit or scope of the invention. The 
present invention covers the modifications and varia- 
tions of this invention provided they come within the 
scope of the appended claims and their equivalents. In 

35 this context, equivalents means each and every imple- 
mentation for carrying out the functions recited in the 
claims, even those not explicitly described herein. 



40 Claims 

1. A method of displaying a three-dimensional image 
comprising: 

45 receiving a first set of data representing a three- 

dimensional image; 

projecting a first plurality of light beams based 
upon the first set of data onto a reflective de- 
vice; and 

reflecting the light beams to focal points above 
the reflecting device in a manner to display a 
referenceable three-dimensional image in un- 
surrounded space. 

55 2. The method of claim 1 , further comprising: 

receiving signals from a user interface device; 
and 
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generating a second set of data based upon the 
first set of data and the signals from the user 
interface device. 

The method of claim 2, further comprising: s 

projecting a second plurality o1 points of light 
onto a reflective device based upon the second set 
of data. 

A method of displaying a three-dimensional image io 
comprising: 



receiving a first set of data representing a three- 
dimensional image; 

dividing the first set of data into a first plurality 
of data subsets, each data subset correspond- 
ing to a two-dimensional slice of the three-di- 
mensional image; 

projecting a first plurality of light beams onto a 
reflective device in accordance with the first 
plurality of data subsets; and 
reflecting the first plurality of light beams to fo- 
cal points beyond the reflective device to dis- 
play a ret erenceable three-dimensional image 
in unsurrounded space. 



5. The method of claim 4. further comprising: 

receiving signals from a user interface device; 
and 

generating a second set of data based upon the 
first set of data and the signals from the user 
interface device. 

6. The method of claim 5, further comprising: 

dividing the second set of data into a- second 
plurality of data subsets, each data subset cor- 
responding to a two-dimensional slice of the 
three-dimensional image; and 
projecting a second plurality of light beams onto 
the reflective device based upon the second 
plurality of data subsets. 

7. The method of claim 4, wherein the step of project- 
ing a first plurality of light beams comprises: 

projecting sequentially each set of light 
beams to focal points in accordance with the first 
plurality of data subsets. 

8. A method of displaying a three-dimensional image 
comprising: 

receiving a first set of data representing a three- 
dimensional image; 

dividing the first set of data into a first plurality 
of data subsets, each data subset correspond- 
ing to a two-dimensional slice of the three-di- 



15 



mensional image; 

activating a plurality of light beams based upon 
the first plurality of data subsets; and 
projecting the plurality o1 light beams to focal 
points to display a referenceable three-dimen- 
sional image in unsurrounded space. 

9. The method of claim 8. further comprising: 

receiving signals from a user interface device; 
and 

generating a second set of data based upon the 
first set of data and the signals from the user 
interface device. 

10. The method of claim 8, further comprising: 

dividing the second set of data into a second 
plurality of data subsets, each data subset cor- 
responding to a two-dimensional slice of the 
three-dimensional image; and. 
activating a plurality of light beams based upon 
the second plurality of data subsets. 



25 11. The method of claim 8, wherein the step of project- 
ing the plurality of light beams comprises: 

projecting sequentially the plurality of light 
beams in sets of light beams, the sets of light beams 
corresponding to the data subsets, the light beams 
projected to focal points in a nnanner to display a 
referenceable three-dimensional image in unsur- 
rounded space. 

12. An image display apparatus comprising: 



20 



30 



35 
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55 



a device [300] for receiving a first set of data 
representing a three-dimensional image; 
a first projector [200] for projecting a first plu- 
rality of light beams onto a reflective device 
[400]based upon the first set of data; and 
a reflective device [400] for reflecting the light 
beams to focal points above the reflecting de- 
vice in a manner to display a referenceable 
three-dimensional image in unsurrounded 
space. 

13. The apparatus of claim 12, further comprising: 

a user interface device [500]; and 

a processor [100] programmed to generate a 

second set of data based upon the first set of 
data and signals from the user interface device 
[500]. 

14. The apparatus of claim 13, further comprising: 

a second projector [200] for projecting a sec- 
ond plurality of light beams onto the reflective de- 
vice [400] based upon the second set of data. 
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15. The apparatus of claim 14, wherein the processor 
[100] is programmed to generate a plurality of im- 
age layers from the first set of data, each image lay- 
er comprising a subset of the first set of data and 
representing a two-dimensional section ot the 
three-dimensional image, and wherein the projector 
[200] comprises: 

a plurality of arrays of light elements [210-21 9]; 
and 

a controller [300] for controlling the display of 
the image layers using the arrays. 

16. The apparatus of claim 15, wherein the controller 

comprises: 

a plurality of array drivers [310-319], each ar- 
ray driver controlling the display of one of the image 
layers on one of the arrays. 

17. The apparatus of claim 16, wherein the controller 
comprises: 

a sequencer [340] for causing the plurality of 
array drivers to display the image layers sequential- 

ly- 

18. The apparatus of claim 16. further comprising: 

a multiplexer [330] for selecting at least one 
of the plurality of array drivers to reflect a modified 
first set of data. 

19. The apparatus of claim 15, wherein the device for 
reflecting comprises: 

a first parabolic mirror [410] including a mir- 
rored surface on the concave surface of the mir- 
ror and having an opening in the center of the 
mirror; and 

a second parabolic mirror [420] including a mir- 
rored surface on the concave surface of the mir- 
ror and positioned so that the concave side of 
the second parabolic mirror [420] faces the con- 
cave side of the first parabolic mirror[410]. 

20. The apparatus of claim 15, wherein the reflective 
device [400] comprises: 

a Fresnel lens. 

21. The apparatus of claim 13, wherein the user inter- 
face device [500] comprises: 

a position detect bn device for generating inter- 
face device position information describing the 
position of the interface device with respect to 
the three-dimensional image; 
a second processor for computing a second set 
of data based upon the first set of data to reflect 
changes in the interface device position infor- 
mation; and 



a transmitter for sending the second set of data 
to the input device. 

22. The apparatus of claim 1 5, wherein the interface de- 
s vice [500] comprises: 

a data glove. 

23. The apparatus of claim 1 5, wherein the interface de- 
vice [500] comprises: 

10 a light pen. 

24. The apparatus of claim 1 3, further comprising: 

an image generating means for generating 
the first set of data representing a three-dim ension- 
f5 al image. 
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(57) An apparatus displays an image [1 40] in three- 
dimensional virtual space In a form that may be modified 
by a user using an interface device [500]. The apparatus 
divides computer-generated data representing 3D im- 
ages into data subsets representing two-dimensional 
slices of the 3D image. The apparatus displays each im- 
age slice on a layer in a stack of liquid crystal displays 
(LCD) [210-219]. The stack sequentially displays the 
layers of the image at a fast rate to appear as a single 
3D -image [1 40]. Each layer in the stack has a dedicated 
driver and memory. The apparatus includes a reflector 
[400] for reflecting the 3D image in a manner so as to 
produce a virtual image in unsurrounded space capable 
of being viewed from every direction. Spectators may 
use a user interface device [500] to touch or manipulate 
the virtual image. The user interface device [500] trans- 
mits data to the apparatus, which generates data to 
modify the virtual image. 
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